AD-A0A7  797  nAVAL  OCEAN  SYSTEMS  CENTER  SAN  DIEGO  CA  F/G  9/<* 

COMPARISON  OF  DETECTION  PERFORMANCE  OF  SELECTED  TWO-CHANNEL  ALG— ETC(U) 
SEP  T9  OJ  EDELBLUTE*  C  L  MELAND 

UNCLASSIFIED  nOSC/TD-328  _  _ NL _ 


W  FILE  CQP^i  •  ADA087797 


LEVEL* 


Technical  Document  328 

COMPARISON  OF  DETECTION 
PERFORMANCE  OF  SELECTED 
TWO-CHANNEL  ALGORITHMS 


^\C 

<V 

CV 

•  # 

4  < 


D.  J.  Edelblute 
CL.  Meland 

28  September  1979 


Approved  for  public  release;  distribution  unlimited 


NAVAL  OCEAN  SYSTEMS  CENTER 
SAN  DIEGO,  CALIFORNIA  92152 


RC.  8  11  106_ 


NOSC  TD  328 


AN  ACTIVITY  OF  THE  NAVAL  MATERIAL  COMMAND 


SL  GUILLE,  CAPT,  USN 


Commander 


HL  BLOOD 

Technical  Director 


ADMINISTRATIVE  INFORMATION 

The  work  was  conducted  by  personnel  of  the  Analysis  and  Processing 
Branch,  Systems  Applications  Division,  by  means  of  funding  provided  under 
program  element  61 152N,  project  ZR00001,  task  area  ZR01 10812,  and  work 
unit  71 1-ZS04. 


Released  by 
T.  F.  Ball,  Head 
Systems  Applications 
Division 


Under  authority  of 
Dr.  H.  A.  Schenck,  Head 
Undersea  Surveillance 
Department 


_ UNCLASSIFIED _ 

SECURITY  CLASSIFICATION  OF  THIS  PAGE  flWl«n  Pete  Entered) 

r"  REPORT  DOCUMENTATION  PAGE 


I  1.  REPORT  NUMBER 


J2.  GOVT  ACCESSION  NO. 


NOSC  Technical  Document  328  (TD  328)  j. 

«.  TITLE  (end  Subtitle' 

j  COMPARISON  0F£ETECT10NJ£RF0RMANCE 
!  ^F  SELECTED  TWO-CHANNEL  ALGORITHMS  / 


17.  AUTHORS 


\  I  D.  J^idelblute 
/  'I  C.  Ly^eland 


READ  INSTRUCTIONS 

_ BEFORE  COMPLETING  FORM 

3.  RECIPIENT'S  catalog  number 


y.  TYPE  OF  REPORT  *  PERIOD  COVERED 

Final/roject  Repitt#^ 

6.  PERFORMING  ORG.  REPORT  NUMBER 
•  .  CONTRACT  OR  GRANT  NUMBER?JJ 


Qj)i? 


-  ‘  r 


9.  PERFORMING  ORGANIZATION  NAME  AND  ADDRESS 

Naval  Ocean  Systems  Center  y 
San  Diego,  CA  92152  * 

<1.  CONTROLLING  OFFICE  NAME  AND  ADDRESS 


Naval  Ocean  Systems  Center 
San  Diego,  CA  92152 


/7  )Zr  J J.  z  *  j-'  ' 


U  MONITORING  AGENCY  name  a  ADDRESS^//  dltleront  from  Controlling  Office) 


Ti¬ 


to.  PROGRAM  ELEMENT.  PROJECT.  TASK 
AREA  ft  WORK  UNIT  NUMBERS 

J/STT52N ,  Z  RflOOQ  1 ,  Z  R  0 1 1 08 1 2 . 

^  711-ZS04" 

12.  REPORT  OATE 

28  September  1979 

13.  NUMBER  OF  PAGES 

36 _ 

IS.  SECURITY  CLASS,  (cl  thle  report) 

Unclassified 


IS*.  OECLASSI  FI  CATION /DOWN  GRADING 
SCHEDULE 


I  16.  DISTRIBUTION  STATEMENT  (o I  thle  R.por I) 


Approved  for  public  release;  distribution  unlimited 


17.  DISTRIBUTION  STATEMENT  (of  the  ebmtrect  entered  In  Block  20,  II  different  from  Report) 


IS  supplementary  notes 


1 19.  KEY  WOROS  (Continue  on  reverae  tide  II  n«c««iiir  and  Identity  by  block  number ) 


Interarray  processing  (l  AP) 
Two-channel  algorithms 
Data  sequence  correlation 


Detection 

Tracking 


20.  ABSTRACT  (Continue  on  reverae  aide  It  neceaemry  end  Identity  by  block  number) 

^Recent  work  on  intersensor  processing  has  stimulated  interest  in  techniques  for  determining  information  common 
to  two  data  sequences  which  may  be  used  for  detection,  tracking  or  a  combination  of  these  and  other  functions. 
Three  algorithms  which  seemed  naturally  to  suggest  themselves  for  intersensor  processing  were  compared.  It  was 
determined  that  the  use  of  a  normalization  factor  significantly  degrades  detection  performance  in  regions  charac¬ 
terized  by  low  time-bandwidth  product  TW  <  64.  For  TW  >  120,  all  three  algorithms  performed  about  equally 
on  the  detection  function.  The  principal  implication  of  this  work  is  that  the  operating  mode  of  the  system 
(which  may  dictate  the  low  time-bandwidth  product  used)  may  affect  the  choice  of  algorithms  to  be  used.  In  a 


do 


EDITION  OF  1  NOV  •(  IS  OBSOLETE 

S/N  01 02-LF-01 4-6601 


UNCLASS1F1KD 

SECURITY  CLASSIFICATION  OF  THIS  PAOE  fBNwi  Dele  Bntetod) 


UNCLASSIFIED _ _ 


tBCUMTV  CLASSIFICATION  OF  THIS  FAOt  Dmt  ■>(«•« 


20.  Continued. 


"tactical  application  where  decisions  must  be  made  quickly,  use  of  an  unnormalized  correlator  may  be  mandatory. 
In  a  situation  where  long  integration  times  are  acceptable,  a  normalized  formula  such  as  the  coherence  detector 
may  be  chosen  for  data  processing,  as  opposed  to  signal  processing,  economies.  ^ 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  OF  THIS  FAOtflWW"  Dm* 


I 


CONTENTS 

INTRODUCTION  .  .  .  page  3 
PROBLEM  DEFINITION  AND  NOTATION  ...  4 

THEORY  ...  12 

Square  Law  Detector  ...  1 2 
Correlator  ...  13 
Correlation  Coefficient  ...  15 
Coherence  Detector  ...  15 
Discussion  ...  16 

COMPARISON  WITH  EXPERIMENTAL  DATA  ...  16 
RESULTS  AND  DISCUSSION  ...  28 
REFERENCES  ...  35 

ILLUSTRATIONS 

Two-channel  detector  structures  .  .  .  page  6 
Square  law  detector  ...  9 
Correlator  ...  9 
Correlation  coefficient  ...  10 
Coherence  detector  ...  10 

Threshold  signal-to-noise  ratio  at  algorithm  output  ...  1 1 
Alternate  signal  assumptions  ...  17 

Threshold  signal-to-noise  ratio  as  a  function  of  WT ;  Pp  =  1 0*®  ...  29 
Threshold  signal-to-noise  ratio  as  a  function  of  WT ;  Pp  =  1 0'^  ...  29 
Threshold  signal-to-noise  ratio  as  a  function  of  WT;  Pp  =  1  O'4  ...  30 
Algorithm  performance  as  a  function  of  time-bandwidth  product;  Pp  =  1  O'4  ...  32 
Algorithm  performance  as  a  function  of  time-bandwidth  product;  Pp  =  10'^  ...  32 
Algorithm  performance  as  a  function  of  time-bandwidth  product;  Pp  =  10'®  ...  32 
Algorithm  performance  as  a  function  of  time-bandwidth  product;  Pp  =  1  O'4  ...  33 
Algorithm  performance  as  a  function  of  time-bandwidth  product;  Pp  =  10^  ...  33 
Algorithm  performance  as  a  function  of  time-bandwidth  product;  Pp  =  10'^  ...  33 
Algorithm  performance  as  a  function  of  time-bandwidth  product;  Pp  =  10"4  ...  34 
Algorithm  performance  as  a  function  of  time-bandwidth  product;  Pp  =  10"^  .  .  .  34 
Algorithm  performance  as  a  function  of  time-bandwidth  product;  Pp  =  10‘^  ...  34 

TABLES 

1.  Faise-alarm  probability  differences,  WT  =  8  (Theory-observed)  .  .  .  page  18 

2.  PD  as  a  function  of  TW  and  TSNR;  square  law  detector-Gaussian  signal  ...  20 

3.  Pp  as  a  function  of  TW  and  TSNR;  square  law  detector-constant  signal  ...  21 

4.  Pp  as  a  function  of  TW  and  TSNR;  correlator-Gaussian  signal  ...  22 

5.  Pp  as  a  function  of  TW  and  TSNR;  correlator-constant  signal  ...  23 


1. 

1 

3. 

4. 

5. 

6. 

7. 

8. 
9. 

10. 

11. 

12. 

13. 

14. 

15. 

16. 

17. 

18. 
19. 


i  Acaesdloajtor 

!  MTK  (BUM 
DDC  TAB 
I  UaaatuouncM 
j  Justificative* 


!  Distribution/ 

— 

I  AOSi l ?jb  1 1.1  ty  C o3«s 
l  Avail  and/or 

j  D1  st  special 


A 


TABLES  (Continued) 


6.  Pp  as  a  function  of  TW  and  TSNR;  correlation  coefficient-Gaussian  signal  .  .  .  page  24 

7.  Pp  as  a  function  of  TW  and  TSNR;  correlation  coefficient-constant  signal ...  25 

8.  Pp  as  a  function  of  TW  and  TSNR;  coherence  detector-Gaussian  signal  ...  26 

9.  Pp  as  a  function  of  TW  and  TSNR;  coherence  detector-constant  signal  ...  27 


INTRODUCTION 


Recent  work  on  interarray  processing  ( I AP )  has  stimulated  interest  in  techniques 
for  correlating  two  data  sequences.  Such  correlations  may  he  used  for  detection  or  tracking 
or  a  combination  of  functions.  This  paper  focuses  on  the  detection  function.  The  purpose 
of  this  study  was  to  investigate  the  properties  of  three  algorithms  which  seem  naturally  to 
suggest  themselves  for  IAP.  The  first  such  algorithm  simply  correlates  the  two  sequences. 

The  other  two  algorithms  normalize  this  value  to  a  range  from  zero  to  one  to  form  the  familiar 
correlation  coefficient  or  the  coherence.  To  provide  a  baseline,  all  three  were  compared  to 
the  detection  performance  which  would  be  achieved  by  using  one  array  only,  with  the  usual, 
simpler  square  law  detection. 

The  increasing  interest  in  IAP  was  one  reason  why  such  a  study  seemed  appropriate. 
However,  almost  all  IAP  work  to  date  has  concentrated  on  one  specific  algorithm:  the 
coherence  detector.  A  major  goal  of  this  study  was  to  open  up  the  field  to  consideration 
of  possible  alternatives  which  might,  in  some  cases,  be  advantageous. 

Comparison  of  these  algorithms  is,  however,  a  nontrivial  problem  for  two  reasons. 

First,  each  estimator  has  different  statistical  properties  which  are  difficult  to  summarize. 
Second,  the  comparison  can  appear  quite  different  for  different  sample  sizes  (or  time- 
bandwidth  products).  Since  assumed  false-alarm  probability,  probability  of  detection,  and 
integration  time  all  affect  the  comparison,  a  fairly  careful  study  was  needed. 

For  such  a  study,  some  assumptions  had  to  be  made.  The  first  was  that  the  noise  in 
both  sequences  was  stationary,  Gaussian,  and  uncorrelated  between  sequences.  This  assump¬ 
tion  was  tested  by  means  of  recorded  ocean  noise.  The  second  assumption  was  that  the  sig¬ 
nal  was  either  a  pure  sinusoid  (constant  in  the  filtered  data)  or  was  a  Gaussian  process  which 
differed  from  the  noise  only  in  amplitude  and  by  its  presence  in  both  sequences.  It  was  felt 
that  these  two  assumptions  should  bracket  the  realistic  cases.  Both  cases  were  analyzed. 

The  third,  and  most  questionable,  assumption  was  that  the  signal-to-noise  ratio  in  both 
sequences  was  the  same.  This  assumption  was  made  partly  to  simplify  the  problem  to  bring 
it  within  the  scope  of  a  I -year  effort,  and  partly  because  it  is  the  most  favorable  case  for 
comparison  of  IAP  detection  performance  to  single  array  performance. 

The  major  results  may  be  summarized  as  follows: 

1 .  For  time-bandwidth  products  less  than  about  64.  the  use  of  a  normalization 
factor  significantly  degrades  detection  performance.  In  this  region,  even  a 
square  law  detector  operating  on  one  array  is  likely  to  be  superior.  However, 
the  unnormalized  correlator  performs  well. 

2.  For  time-bandwidth  products  greater  than  about  I  2K.  all  three  IAP  algorithms 
perform  about  the  same,  so  a  selection  among  them  can  be  made  properly  on 
criteria  other  than  detection. 

T  The  results  are  not  highly  sensitive  to  the  choice  of  a  Gaussian  or  a  steady-state 
signal  assumption. 

4.  The  tabulations  and  plots  contained  in  this  report  should  aid  a  system  designer 
to  estimate  performance. 


5.  When  tests  were  run  by  means  of  recorded  ocean  noise,  the  results  were  con¬ 
sistent  with  the  theoretical  predictions  based  on  a  Gaussian  noise  assumption. 


The  principal  implication  is  that  the  operating  mode  of  the  system  (which  may  dic¬ 
tate  the  time-bandwidth  product  used)  may  affect  the  choice  of  algorithm.  In  a  tactical 
application  where  decisions  must  be  made  quickly,  use  of  an  unnormalized  correlator  may 
be  mandatory.  In  a  situation  where  long  integration  times  are  acceptable,  a  normalized  for¬ 
mula  such  as  the  coherence  detector  may  be  chosen  for  display  economy. 

It  should  be  noted  that  there  are  no  significant  differences  in  computational  load  or 
required  computing  speed  between  any  of  these  algorithms.  The  “front  end”  of  such  a  sys¬ 
tem  would  likewise  be  unaffected. 

The  subject  is  by  no  means  exhausted.  The  results  should  eventually  be  extended  to 
include  the  case  of  unequal  signal-to-noise  ratios  in  the  two  sequences.  Field  comparisons 
can  also  contribute  significantly. 


PROBLEM  DEFINITION  AND  NOTATION 

Let  x(i)  and  y(i)  denote  the  two  data  sequences.  Since  the  discussion  concerns  nar¬ 
rowband  data,  both  data  sequences  are  assumed  to  be  complex  with  zero  mean.  It  is  also 
assumed  that  any  necessary  time  and/or  frequency  shifting  has  already  been  done  to  align 
the  possible  signals.  Let  x*x.  y*y,  and  x*y  denote  the  second  moments  which  are  estimated 
by: 

K 

i=l 
K 

<y*y)=I^ 

i=l 

<x*y>=^ 

i=l 

where  <quantity>  denotes  the  estimator  of  the  quantity. 

It  is  assumed  that  samples  from  different  times  are  independent,  so  that  K  is  the  true  number 
of  degrees  of  freedom  in  the  estimator  (ie,  the  time-bandwidth  product). 

Let  s(i),  n  |  (i),  and  n2(i)  denote  the  signal,  the  noise  in  x(i),  and  the  noise  in  y(i), 
respectively.  The  problem  is  to  choose  between  the  hypotheses: 

H0:  x(i)  =  n | (i) 
y(i)  =  n2(i) 

Hj:  x(i)  =  s(i)  +  nj(i) 
y(i)  =  s(i)  +  n2(i). 


x*(i)  xti) 

y*(i)  y(i) 
x*(i)  y(i). 
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The  following  definitions  and  assumptions  are  made; 

S__  * 

-  s  s 

N  =  n*  nj  =  n*  n-> 

O  =  n *  ih  =  s*n |  =  s*ni, 

ie,  the  noises  in  the  sequences  are  assumed  independent  and  of  equal  power,  and  the  signal 
is  independent  of  all  noise.  Most  importantly,  nj  and  nT  are  assumed  to  be  complex 
Gaussian  random  variables  of  zero  mean. 

A  thresholding  test  procedure  is  to  be  used.  That  is,  a  test  variable,  t,  will  be  com¬ 
puted  from  the  second  moments  and  compared  with  a  predetermined  threshold,  T.  (In 
some  cases.  T  must  be  based  on  N.)  The  choice  of  t  may  vary  with  the  application.  Various 
optimality  arguments,  based  on  different  assumptions,  may  give  a  variety  of  formulas  for  it. 

It  is  not  the  function  of  this  project  to  sort  out  these  arguments.  Rather,  the  purpose  here 
is  to  compare  some  natural  choices  on  the  basis  of  initial  detection  performance  which  is 
not  necessarily  the  criterion  under  which  the  formula  for  t  may  be  chosen. 

The  simplest  detection  procedure  is  to  ignore  the  dual-sequence  nature  of  the  data, 
pick,  one  sequence,  and  use  a  square  law  detector.  Since  this  is  the  simplest  and  easiest  tech¬ 
nique,  it  will  be  used  as  a  baseline  against  which  the  other  techniques  will  be  compared. 

In  this  case,  the  test  variable,  t  j ,  is  simply 
tj  =  <x*x>. 

and  the  test  procedure  is 

H. 

tj  =  <x*x>  3*  TjN. 

H0 

A  second  obvious  choice  for  t  (suggested  by  certain  matched  filter  arguments)  is  to 
correlate  the  two  sequences.  Here  the  test  procedure  is 

H1 

t-,  =  Re<x*y>  3*  T iN. 

H0 

Since  this  formula  uses  information  from  both  sequences,  it  seems  intuitively  that  it  should 
perform  better  than  t] .  This  will  be  shown  to  be  the  case,  although  it  should  be  remembered 
that  this  assumes  an  equal  signal-to-noise  ratio  in  both  sequences. 

Although  both  of  the  above  formulas  perform  fairly  well,  as  will  be  shown,  the  deter¬ 
mination  of  the  threshold  depends  on  a  prior  estimate  of  the  noise  level.  N.  Usually  there 
are  various  ways  this  can  be  done.  However,  this  requirement  can  be  removed  by  the  nor¬ 
malization  used  in  calculation  of  correlation  coefficients.  In  this  case,  the  test  procedure  is 
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*  H1 

,3  -  a  T 


3- 


\/<x*x>  <y*y>  Hq 

Here,  T3  can  be  computed  simply  as  a  function  of  false-alarm  rate. 

Concern  for  phase  uncertainties  in  the  signal  has  led  some  people  to  use  a  slightly 
more  robust  formula: 


l<x  y)h 
4  ,  *  v 


H 


<x*x>  (y  y)  H0 


t4 


These  options  are  illustrated  in  figure  1 .  As  can  be  seen,  most  of  the  computational 
effort  is  expended  in  computing  the  estimated  second  moments,  <x*x>,  (y*y>,  and  (x*y>. 
Thus  there  is  little  to  choose  from  when  comparing  the  computational  load  of  one  formula 
versus  another  (except  for  t|  =  <x*x>). 

It  should  be  noted  that  one  of  the  formulas,  ((x  +  y)*(x  +  y)>  is  not  analyzed.  This  is 
because  it  does  not  constitute  a  separate  case.  It  is  a  power  estimator  and  therefore  has  the 
same  statistical  properties  as  <x*x>.  It  simply  has  a  3-dB  improvement  in  signal-to-noise 
ratio.  Thus  whatever  detection  performance  is  achieved  with  (x*x>  is  achieved  with  a  3-dB 
lower  input  signal-to-noise  ratio  using  <(  x  +  y  )*(x  +  y)>. 

The  central  problem  is  to  compare  the  detection  performances  of  tj ,  to.  t3_  and  t/p 
This  is  complicated  by  the  fact  that  each  test  variable  has  different  distributional  properties 
(eg.  the  relationship  between  false-alarm  probability  and  threshold)  and  different  relation¬ 
ship  to  the  input  parameters. 


SQUARE  LAW 
DETECTOR 


CORRELATOR 


COHERENCE 


(Re  <x«y)  1_  CORRELATION 
(  x*x  >  ( y*y  )  COEFFICIENT 


(lx  +  y  1  >  =  (x*x)  +  <y*y>  +  2Re  (x*y> 
SUMMER 


Figure  1.  Two-channel  detector  structures. 
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Comparisons  of  this  sort  arc  sometimes  made  by  using  receiver  operating  characteris¬ 
tics  (ROO  curves,  which  are  plots  of  probability  of  detection,  Pj,  versus  false-alarm  proba¬ 
bility,  Pf  (see  reference  1 ).  This  approach  is  unsatisfactory  here  because: 

1 .  Each  curve  describes  only  one  set  of  processing  parameters  (signal-to-noise 
ratio  and  integration  time)  and  an  inordinate  number  of  such  curves  would  be 
required. 

2.  ROC  curves  tend  to  be  too  sensitive.  In  the  key  cases,  the  values  of  Ptj  and  Pj 
change  very  fast  relative  to  fairly  small  changes  in  signal  strength  or  time- 
bandwidth  product. 

A  somewhat  more  instructive  approach  is  to  plot  false-alarm  probability,  Pj,  versus 
threshold.  However,  the  relationship  between  threshold  and  other  important  parameters  is 
not  obvious,  so  the  value  of  such  plots  seems  limited.  But  the  threshold  does  have  signifi¬ 
cance  in  terms  of  the  signal  strength,  or  signal-to-noise  ratio,  which  will  trigger  the  detector. 
To  see  how  this  works,  consider  for  each  detector  the  case  where  the  signal  strength  is  mar¬ 
ginally  enough  to  trigger  the  detector. 

For  the  square  law  detector. 

t,  =  x"*x  =  T,  N  or 

(s  +  ii|  )*<s  +  n j )  =  T|N 

S  +  N  =  TjN 

S/N  +  1  =  T, . 

For  the  correlator, 

t  t  =  Re  x*y  =  TaN  or 

(s  +  n  j  )*<s  +  n->)  =  TiN 

S  =t2n 

S/N  =  T-). 


For  the  normalized  formulas,  it  is  convenient  to  be  a  little  careless  about  the  averag¬ 
ing  process.  This  will  introduce  a  bias  in  the  formulas,  but  it  will  later  be  shown  to  be  unim¬ 
portant.  Actually,  because  of  asymmetries  in  the  distributions,  all  of  the  formulas  contain 
biases  which  will  be  shown  to  be  small  and  unimportant. 

For  the  correlation  coefficient. 


_  Re  x  y  _  T 
>3"  r==r===-  1 3 
V<x*x>  <y*y> 


1 .  Van  Trees,  H.  L.,  Detection.  Estimation  and  Modulation  Theory.  Part  I.  John  Wiley  and  Sons.  Inc..  I D(S8. 
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~*Mn 


pm*-*** 


m\  i  ,  ja.i  vm  -  >  P  f'.iiU 


( s  +  n  1  )*(s  +  nil 


=  T 


3 


\/<  S  +  N )  ( S  +  N )  T3 
(S/N) 

(S/N  +  l)  3' 

In  a  similar  manner,  for  the  coherence  detector. 


I(s  +  n  | )  (s  +  m)|~ 

-  ~  -  . =  TV, 

(s  +  n |  )*(s  +  n j )  (s  +  n  j  )*(s  +  n-t) 

-S2  _  =  T 

(S  +  N)2  4 

(S/N)2 

i  4* 

(S/N  +  D- 


Thus  each  threshold  can  be  expressed  in  terms  of  a  signal-to-noise  ratio  which  must 
be  exceeded  for  reliable  detection.  This  will  be  called  the  threshold  signal-to-noise  ratio 
(TSNR).  So.  instead  of  plotting  false-alarm  probability  versus  threshold,  the  false-alarm 
probability  will  be  plotted  as  a  function  of  TSNR.  Thus  plots  of  false-alarm  rate  versus 
TSNR  can  be  directly  compared  for  each  algorithm.  Asa  side  issue,  the  t->  and  t}  test  varia¬ 
bles  assume  both  positive  and  negative  values,  whereas  the  other  test  variables  are  positive. 
For  this  reason,  the  plotted  Pf  for  tT  and  t3  are  “two-sided”:  that  is,  they  indicate  the  prob¬ 
ability  that  the  magnitude  of  the  test  variable  will  exceed  the  threshold  on  the  positive  or 
negative  side.  As  is  apparent  in  the  figures,  this  has  a  very  small  effect  on  the  result  because 
of  the  small  slope  of  the  curves  for  Pf  of  any  practical  interest. 

These  plots,  figures  2,  3,  4,  and  5,  form  the  primary  result  of  this  study.  Figure  6 
displays  the  TSNR  for  the  algorithms  under  consideration  as  a  function  of  Pp  for  three 
selected  time  bandwidth  products  which  span  the  region  of  most  applications.  It  illustrates 
where  the  algorithms  differ  and  where  the  differences  become  negligible.  The  rest  of  this 
paper  is  concerned  with  how  these  plots  were  derived,  what  changes  would  result  from  slight 
variations  in  assumptions  (ie.  how  representative  of  actual  situations  these  results  are  likely 
to  be)  and  what  the  implications  are. 
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THEORY 


The  first  problem  is  to  derive  the  false-alarin  probability  equation  for  each  process. 
Recall  that  these  deviations  all  assume  that  S  =  0,  and  that  nj  and  n2  are  independent 
complex  random  variables  with  zero  means  and  equal  variances,  n  ]n  j  =  n2n2  =  N.  The 
equations  will  give  the  false-alarm  rate,  Pf,  in  terms  of  the  thresholds,  Tj ,  T2,  T3,  and  T4. 
However,  the  plots  will  be  done  in  terms  of  the  threshold  signal-to-noise  ratios.  As  noted 
above,  these  are  connected  to  T) ,  T2,  T3,  and  T4,  by 

(S/N),  =  T ,  -  1 

(S/N)2  =  T2 

(S/N)3  =  T3/(1  -t3) 

(S/N)4=Vt^/(1  -n/T^). 

SQUARE  LAW  DETECTOR 

For  the  square  law  detector,  the  theory  is  especially  well  known.  Since  ni  is  com- 

♦  1 

posed  of  a  real  part  and  an  imaginary  part,  |n  j  I  is  a  Raleigh  variable.  Then  n|  n]  has  an 
exponential  distribution.  Letui  =x|x]  =  nfnj,  fj(u)  denote  the  probability  density 
function  of  uj,  and  F  j ( u )  denote  the  cumulative  probability  function  of  u.  Then 

f  1  ( u I )  =  ^-exp  (-U) /N). 


Since  the  test  variable  is 


t]  =-[n,(l)  +  u,(2)+-+  u  j  ( K )  ] , 

the  probability  density  function  of  t)  can  be  obtained  by  repeated  convolutions  of  the 
f](U] ).  This  results  in  a  Gamma  distribution: 


(K/N)  (Kt|/N)K_I  exp  (-K  t,/N) 


1  |(t| ,  K)  - 


(K  -  1)! 

So,  for  the  square  law  detector 


PF(T1  >  ~ 


r 

/  f ,  ( t ,  K) 

A,N 

-L_f 

K  -II!/ 

•/T.N 


(Kt,  /N)K_*  exp  (-Kti/N)  (K/N)  dt , 


F(K,KT,N/N)  r(K,KTt) 


T(K) 


T(K) 
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where  I  (k.  KT | )  and  r(K)  are  the  incomplete  gamma  function  and  the  gamma  function, 
respectively.  For  the  purposes  of  this  discussion,  they  are  characterized  by  the  relationships 

T(K)  =  (K  -  1  >! 


HR  +  1.  u)=  KF(K,  u)  +  uK  exp  <-u). 

CORRELATOR 

The  theory  for  the  correlator  is  less  well  known  and  somewhat  more  difficult  to 
derive.  It  is  convenient  to  convert  the  problem  to  one  involving  real  variables  by  letting 
ni  =  nr]  +\/-T  ni j  and  n->  =  nrs  +  \/-T  ni->.  Therefore,  Re  (njn-i)  =  nrj  nr->  +  ni | ni 
Since,  for  Gaussian  distributions,  the  real  and  imaginary  parts  of  a  variable  are  independent, 
the  process  of  averaging  the  real  part  of  K  complex  products  is  the  same  as  averaging  2K 
real  products. 

First,  let  u  and  v  denote  two  independent,  zero  mean.  Gaussian  random  variables. 


uv  =  0 
~  i 
u~  =  Oj 


The  joint  distribution  function  is 


Now  if  w  =  uv,  the  distribution  function  for  w  becomes 

—  f(w/v,  v)  dv 

-OO 


where  Kq 's  a 


argument. 
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Since  the  test  variable  is  computed  by  averaging  2K  different  values  of  w,  the  obvious 
procedure  is  to  use  repeated  convolutions  of  Kq  with  itself.  However,  it  seems  easier  to  use 
Fourier  transforms. 


F  |  f  <  w )  \  = 


u_r 


exp  <-\/-T  ojw)  K 


dw 


I 


\/ I  +  (UJOjO-))- 

So  if  W  =  wj  +  w ->+■••  +  ww.  then 

*K 


F  |f(W)} 


■(— 

\l  +  (COO|Oi)-/ 


f(W )  = 


7 -  f  ( - - - exp  (V^T  coW)  d 

'nJ-oc  V  +  (CJOjOsl-/ 


CJ 


I  COS  I  C0W/(O|O',)| 

TOiOi  /  .  ,  .  \  K 

1  -Jn  (I  +  co  ) 


dec 


K-l 


exp  [-W/lojOslI  ^'<2K-i-2)!  |2W/(o,o:) 


0|O->  2“^~*  (K  -  I  )! 


i!(K-i  -  11! 


So 


Pt:  = 


I 


f  s2K-l 


(K  -  I  )!  0|C7l 

K-l 


K”  1  °° 

V  1 2K  —  i  —  2 )!  2*  f  /  W  \»  /  -W  v 

2j  i!  <K  —  i  —  1 »!  I  (ci|oJ  lX|'(o|oJ 

2  i=0  ^KNT i  '  1  \  1  -1 


dW 


I 


i2K-l 


(K-l)!^ 


_  i  _  1  M 

Z  ^K-fuTr(i+l  KNT2/q«g2 


Note  that  under  the  above  assumptions  aja-i  =  a~  =  o”  =  N/2.  so  KNT-t/(a  |0-»)  =  2KT-.. 

K-l 


pF,T^"^iTi 


1  V  (2K  -  i  -  2)!  2' 


Tf 


(K  -  11!  jtf  <K  *'  ‘  1)1 


Hi  +  1.  2KT-,). 
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CORRELATION  COEFFICIENT 


The  distribution  of  the  correlation  coefficient  is  well  known  and  documented  once 
the  problem  has  been  translated  from  complex  variables  to  real  variables,  as  was  done  in  the 
derivation  for  the  correlator.  Again,  note  that 

Re  <x*y>  =  -jrl  xr(  I )  yr(  I)  +  xi(  1 )  yi(  1 )  +  •■  •  +  xr(K)  yr(K)  +  xi(K)  yi(K)l, 

K 


<x*x>  =  ”lxr-(  1 )  +  xi-(l )  +  ■  •  •  +  xr-(K)  +  xi-(K)] 

K 

<y*y>  =  ~  lyr-(  1 )  +  yi~(  1 )  +  •  •  +  yr-(K)  +  yi-(K)l. 

So  t  }  looks  like  the  result  of  an  ordinary  estimated  correlation  coefficient  from  2K  real 
variables.  Mood  and  Graybill  (reference  2)  give 


f(p)  = 


1(2K  -  3)/2 1 !  ( 1  -p-)(2K^V: 
\fn  (( 2K  —  4  >/2 1 ! 


However,  this  is  for  the  case  in  which  the  true  mean  value  is  unknown.  Since  the  variables 
were  known  to  be  zero  mean,  the  number  of  degrees  of  freedom  was  increased  by  one. 
(This  was  suggested  by  Dr.  R.  Riffenburgh,  NOSC.)  Thus  the  formula  used  was 


This  formula,  if  integrated  analytically,  leads  to  a  very  cumbersome  expression.  However,  it 
lends  itself  to  numerical  integration.  The  values  plotted  were  computed  by  numerical 
integration. 


COHERENCE  DETECTOR 


The  deviation  involved  in  the  false-alarm  probability  for  the  coherence  detector  is 
rather  involved.  However,  Goodman  (reference  3 )  has  shown  that 

Pp(T4)  =  ( 1  -T4)K-'. 


2.  Mood,  A.  M.,  and  F.  A,  Graybill,  Introduction  to  the  Theory  of  Statistics.  McGraw-Hill,  1963. 

3.  Goodman,  N.  R.,  On  the  Joint  Estimation  of  the  Spectra,  Cospectrum,  and  Quadrature  Spectrum  of  a 
Two-Dimensional  Stationary  Gaussian  Process.  New  York  University.  Engineering  Statistics  Laboratory. 
March  1957. 
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DISCUSSION 


These  formulas  were  used  to  compute  the  values  plotted  in  figures  2,  3,  4,  and  5. 
They  constitute  the  major  results  of  this  report.  However,  before  they  can  be  taken  at  face- 
value,  two  questions  must  be  addressed: 

1 .  How  closely  does  ocean  noise  correspond  to  the  results  which  are  based  on 
(iaussian  input  assumptions? 

2.  Does  consideration  of  the  signal  plus  noise  distributions  change  the  results  sig¬ 
nificantly,  especially  it  a  probability  of  detection  other  than  0.3  is  used'.’ 


COMPARISON  WITH  EXPERIMENTAL  DATA 

The  first  issue  to  he  addressed  is  the  accuracy  with  which  the  theoretical  results  pre¬ 
dict  performance  on  actual  data.  For  this  purpose,  recordings  from  the  DARPA  Fixed 
Mobile  Experiment  were  used.  Data  sequences  were  chosen  which  were  known  to  contain 
no  common  signal.  From  these.  Mr.  L.  Schilling  of  NOSC  computed  sets  of  test  variables 
for  the  normalized  functions:  ie.  the  correlation  coefficient  and  the  coherence  detector.  For 
each  set,  a  cumulative  distribution  function  was  computed.  Since  the  cumulative  distribu¬ 
tion  function  is  one  minus  the  false-alarm  probability,  a  false-alarm  probability  for  each  set 
could  be  tabulated.  Thus  several  dozen  tabulations  of  false-alarm  probability  versus  thresh¬ 
old  signal-to-noise  ratio  were  generated. 

Each  tabulation  represents  the  number  of  false  alarms  encountered  in  a  set  of  1 6,384 
test  values.  However,  the  number  of  independent  values  is  not  known  and  is  probably  much 
smaller  than  16,384.  This  lack  of  knowledge  of  the  precise  number  of  independent  values, 
or  degrees  of  freedom,  is  a  minor  problem  in  interpreting  the  results. 

The  most  thorough  comparisons  were  done  for  the  case  of  WT  =  8.  Although  this 
time-bandwidth  product  is  somewhat  small  for  serious  detection  processing,  it  seems  a  rea¬ 
sonable  choice  for  statistical  testing  of  this  sort. 

For  each  tabulation,  a  comparison  with  the  theoretical  values  (in  figures  4  and  5)  had 
to  be  made.  These  comparisons  needed  to  be  quantitative  and  the  set  of  all  comparisons  had 
to  be  summarized.  The  solution  chosen  was  to  use  the  maximum  absolute  difference 
between  the  theoretical  and  the  observed  false-alarm  counts.  These  comparisons  are  shown 
in  table  1 .  Each  value  shows  the  largest  absolute  difference  between  the  theoretical  false- 
alarm  probability  and  the  observed  false-alarm  probability  for  one  set  of  16,384  values  of 
t-$  and  t4.  To  facilitate  the  comparisons,  the  signs  have  been  preserved.  A  positive  sign  (+) 
means  that  the  greatest  separation  between  theoretical  and  actual  curves  occurred  at  a  point 
where  the  observed  curve  ran  below  the  theoretical  curve.  Thus,  for  the  first  entry,  the  larg¬ 
est  difference  in  false-alarm  rate  was  0.8 '/  at  a  point  where  the  observed  false-alarm  rate  was 
below  the  theoretical  value.  A  mixed  sign  (±)  indicates  that  this  difference  occurred  two  or 
more  times,  and  that  the  observed  curve  was  above  the  theoretical  for  one  of  these  values 
and  below  for  the  other. 
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INTEGRATED  POWER 


Figure  7.  Alternate  signal  assumptions. 


The  tabulated  differences  in  table  1  show  no  obvious  pattern.  This,  plus  the  fact 
that  they  are  small  (never  more  than  V< »,  seems  to  indicate  that  the  theoretical  curves  give 
as  good  a  prediction  of  the  actual  false-alarm  probability  as  reasonably  could  be  expected. 

Unfortunately,  because  the  number  of  independent  values  in  each  set  of  16.3X4 
points  is  unknown,  a  precise  use  of  the  Kolmogorov-Smirnov  test  is  not  possible.  However, 
the  overall  agreement  of  theory  and  observation  appears  excellent. 

The  principal  difficulty  in  dealing  with  the  signal  plus  noise  distribution  considera¬ 
tions  is  the  number  of  special  cases  which  must  be  considered.  The  effort  here  will  be  to 
bracket  the  major  alternatives. 

The  first  problem  is  to  characterize  the  signal.  I  here  are  two  major  alternatives.  The 
signal  can  be  a  Gaussian  random  process  like  the  noise,  or  it  can  be  a  constant  which  is  added 
to  the  noise.  The  difference  is  illustrated  in  figure  7.  For  a  constant  signal,  the  distribution 
of  <x*x>  is  simply  moved  to  the  right.  For  a  Gaussian  signal,  not  only  is  the  distribution 
moved  to  the  right,  hut  the  variance  of  the  signal  is  added  to  the  variance  of  the  noise.  This 
difference  may  be  unimportant  when  a  0.5  probability  of  detection  is  used,  but  may  make  a 
noticeable  difference  if  a  higher  or  lower  probability  is  used.  For  instance,  a  0.1  probability 
of  detection  would  occur  with  a  weaker  signal  under  the  Gaussian  signal  hypothesis  than 
under  the  constant  signal  hypothesis.  However,  to  achieve  a  probability  of  detection  of  0.1> 
requires  a  stronger  signal  under  the  Gaussian  signal  hypothesis. 


The  constant  signal  case  might  arise,  for  instance,  if  the  bandwidth  of  the  signal  is 
much  narrower  than  the  analysis  bandwidth  which  was  used  to  produce  the  narrowband 
data  sequences.  The  Gaussian  signal  case  may  arise  when  the  signal  bandwidth  nearly 
matches  the  analysis  bandwidth. 

The  principal  assumption  with  respect  to  this  issue  is  that  these  two  cases,  Gaussian 
signal  and  constant  signal,  bracket  the  important  real-world  cases. 

Since,  for  the  signal  plus  noise  distributions,  the  probabilities  of  interest  are  limited 
to  roughly  0.05  to  0.95,  it  was  possible  to  obtain  the  probability  curves  with  reasonable 
accuracy  by  means  of  Monte  Carlo  simulations.  (Such  an  approach  would  not  have  worked 
well  for  the  false-alarm  probability  curves  because  of  the  large  number  of  trials  necessary  to 
verify  false-alarm  probabilities  of  10-^  or  10"*  0.1  This  was  fortunate  because  the  theoreti¬ 
cal  functions  are  substantially  more  cumbersome  than  for  the  noise-only  cases. 

A  fairly  extensive  set  of  Monte  Carlo  simulations  was  run  for  various  input  signal-to- 
noise  ratios.  In  each  case,  probability  of  detection  was  tabulated  as  a  function  of  threshold 
signal-to-noise  ratio.  From  these  tabulations,  tables  1  to  9  were  compiled.  For  various 
false-alarm  probabilities,  they  show  what  input  signal-to-noise  ratio  would  be  required  for 
probabilities  of  detection  of  0. 1 . 0.5.  and  0.9. 

From  these,  various  other  tables  and  plots  were  obtained,  as  will  be  described  in  the 
next  section. 
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RESULTS  AND  DISCUSSION 

The  primary  results  are  contained  in  figures  2.  3,  4,  and  5.  These  show  false-alarm 
probability  as  a  function  of  threshold  signal-to-noise  ratio. 

Note  that  this  is  bin  false-alarm  probability,  or  the  probability  of  a  false  alarm  on  a 
single  “look.”  Since  a  practical  system  is  likely  to  have  several  thousand  opportunities  for  a 
false  alarm  (or  several  thousand  “looks”)  in  a  reasonably  short  time  period,  the  system 
false-alarm  rate  per  day  may  be  several  orders  of  magnitude  greater.  Thus,  bin  false-alarm 
probabilities  greater  than  about  I  O'**  are  probably  unacceptable.  The  important  data  in 
figures  2,  3,  4,  and  5  are  between  Pj  =  10'^  and  Pf  =  10'^.  The  remaining  discussion  will 
address  only  this  region. 

Several  points  in  these  figures  are  interesting  to  note. 

In  figure  2.  it  can  be  seen  that,  for  a  given  false-alarm  probability,  the  curves  for  vari¬ 
ous  WT  values  are  separated  by  about  1 .5  dB  in  the  large  WT  cases.  This  agrees  with  the 
general  rule  that  the  integration  gain  of  a  detection  is  5  log  (WT).  However,  for  small  WT 
values,  the  separation  of  the  curves  increases  to  about  2.5  dB.  This  is  because  the  5  log  (WT) 
rule  is  based  on  an  application  of  the  central  limit  theorem,  which  breaks  down  for  small 
WT.  In  some  cases,  this  can  lead  to  a  difference  of  3  or  4  dB  in  minimum  detectable  signal. 

It  is  likely  that  this  difference  is  sometimes  noted  in  system  evaluations  as  “processing  loss" 
or  “operator  loss." 

It  is  interesting  to  note  that  the  curves  in  figure  3  very  closely  overlay  those  in  fig¬ 
ure  2.  with  a  shift  in  WT;  eg,  the  curve  for  WT  =  1  in  figure  3  overlays  the  curve  for  WT  =  2 
in  figure  2.  In  other  words,  the  advantage  in  using  a  correlator  over  using  a  square  law 
detector  is  a  factor  of  1/2  in  the  integration  time  needed  to  achieve  a  given  performance 
level. 


For  large  WT,  the  curves  in  figures  3,  4.  and  5  nearly  overlay.  For  large  WT.  all 
three  of  these  techniques  give  nearly  the  same  performance.  Selection  among  these  formulas 
can  thus  be  made  on  the  basis  of  considerations  other  than  detection  performance,  such  as 
ease  of  implementation. 

For  small  WT,  the  performance  in  curves  4  and  5  deteriorates  rapidly.  In  fact, 
curves  for  WT  less  than  8  were  not  plotted.  This  indicates  that  the  normalized  algorithms 
should  be  used  only  in  high  WT  cases.  In  situations  where  short  integration  time  is  needed, 
the  normalization  should  not  be  used. 

Figures  8,  9,  and  10  were  extracted  from  figures  2,  3,  4,  and  5  to  facilitate  interalgo¬ 
rithm  comparisons.  Figure  8  represents  data  from  a  cut  along  the  Pf  =  I0~^  axis.  Threshold 
signal-to-noise  ratio  (TSNR)  is  plotted  as  a  function  of  time-bandwidth  product  (WT).  Here 
the  deterioration  of  the  normalized  estimators  can  be  clearly  seen. 

As  was  observed  earlier,  the  square  law  detector  provides  a  natural  baseline  to  com¬ 
pare  the  other  algorithms  against.  Only  the  correlator  is  better  for  all  values  of  WT.  (It 
should  be  remembered  that  this  assumes  equal  signal  strength  in  both  sequences.  If  the 
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Figure  10.  Threshold  signal-to-noise  ratio  as  a  function  of  WT. 


signal  in  one  sequence  falls  off,  it  will  decrease  the  performance  of  the  correlator.)  The  nor¬ 
malized  formulas  are  superior  to  the  square  law  detector  only  for  WT  values  greater  than  64. 

Figures  9  and  10  show  similar  data  for  higher  false-alarm  probabilities.  They  indicate 
that  the  results  are  not  very  sensitive  to  false-alarm  probability,  since  the  curves  do  not 
change  very  much.  In  general,  a  change  in  false-alarm  probability  of  four  orders  of  magni¬ 
tude  (for  1 0~8  to  1 0-4)  corresponds  to  a  change  in  TSNR  of  about  3  dB.  For  Pf  =  1 0~4, 
the  crossover  between  the  square  law  detector  and  the  normalized  formulas  has  moved 
slightly  to  the  left  of  WT  =  64. 

Inclusion  of  all  of  the  data  from  the  signal  plus  noise  simulations  would  increase  the 
size  of  this  report  severalfold,  but  without  contributing  much  to  the  utility.  However, 
tables  1  through  8  have  been  extracted  from  those  simulations.  They  use  input  signal-to- 
noise  ratio  (ISNR)  as  the  independent  variable.  Then,  for  each  true  input  signal-to-noise 
ratio,  they  show  the  threshold  signal-to-noise  ratio  at  which  detections  would  occur  with  a 
probability  of  0.9,  0.5,  or  0.1 .  This  can  be  combined  with  the  false-alarm  information. 

For  example,  suppose  a  square  law  detector  with  WT  =  32  is  to  be  used.  What  would 
it  take  to  detect  a  Gaussian  signal  which  appears  at  the  input  with  a  signal-to-noise  ratio  of 
0  dB?  From  table  I ,  such  a  signal  would  be  detected  1 0%  of  the  time  if  the  threshold  signal- 
to-noise  ratio  were  set  at  1 .7  dB.  The  probability  of  detection  could  be  increased  to  50%  by 
lowering  the  threshold  signal-to-noise  ratio  to  -0.1  dB.  To  achieve  a  90%  probability  of 
detection,  the  threshold  signal-to-noise  ratio  would  have  to  be  lowered  further  to  -2.5  dB. 
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However,  from  figure  2,  a  threshold  signal-to-noise  ratio  of  -2.5  dB  corresponds  to 
a  false-alarm  probability  of  about  3  X  10“-V  an  unreasonably  high  value.  Thus  a  W;  proba¬ 
bility  of  detection  is  not  reasonably  achievable.  A  threshold  signal-to-noise  ratio  of -0.1  dB. 
from  the  same  figure,  corresponds  to  a  false-alarm  probability  of  about  3  X  1 0-*’.  which  is 
reasonable.  Thus  a  probability  of  detection  of  50'f  is  achievable  with  a  false-alarm  probabil¬ 
ity  which  may  be  acceptable.  Again,  from  figure  2,  a  threshold  signal-to-noise  ratio  of  1 .7  dB 
corresponds  to  a  false-alarm  probability  of  less  than  IO~tJ.  So  a  probability  of  detection  of 
10'7  can  he  achieved  with  almost  any  reasonable  threshold. 

From  these  tables  and  figures,  figures  1 1  through  19  were  extracted.  Here  the  verti¬ 
cal  axis  shows  the  input  signal-to-noise  ratio  at  which  detections  will  occur  with  a  prescribed 
probability  when  the  detector  has  been  set  for  a  certain  false-alarm  probability.  Moreover, 
when  a  second  line  for  a  given  algorithm  is  discerned,  the  higher  line  applies  to  performance 
with  a  Gaussian  signal.  Figures  1 1  through  19  invite  comparison  with  figures  8.  9.  and  10. 
The  main  result  is  that  the  performance  evaluation  does  not  change  greatly  with  modest 
changes  in  the  assumptions  about  signal  type  or  desired  probability  of  detection.  Thus  one 
can  obtain  a  fairly  good  estimate  of  the  detector  performance  merely  by  using  figures  2 
through  5  and  8  through  10. 

It  should  be  noted  that  none  of  the  above  signal-to-noise  ratios  is  equal  to  the  recog¬ 
nition  differential.  They  differ  from  recognition  differential  at  least  by  a  bandwidth  correc¬ 
tion  factor.  More  importantly,  the  definition  and  measurement  of  recognition  differential 
involve  human  engineering  and/or  system  subtleties  which  are  beyond  the  scope  of  this 
paper. 
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